Three-dimensional light ray input apparatus

ABSTRACT

A three-dimensional input apparatus includes a lens L 1  for converting angular information about light rays from a object, a focusing element L 3  for focusing the light rays from the object to the vicinities of an array R of photoelectric elements, and a lens L 2  for performing conversion into a real image near the surface of the focusing element L 3.  The lens L 2  is present between the lens L 1  and focusing element L 3.  The array R records light as image signal sequentially. A driver portion drives the optical system and scans light ray information about the object.

CROSS-REFERENCE TO RELATED APPLICATION

This application is based upon and claims the benefit of priority fromthe prior Japanese Patent Application No. 2005-263096, filed on Sep. 9,2005 and the prior Japanese Patent Application No. 2006-239587, filed onSep. 4, 2006, the entire contents of which are incorporated herein byreference.

TECHNICAL FIELD

The present invention relates to a three-dimensional light ray inputapparatus for obtaining light ray information displayed on athree-dimensional image reconstruction apparatus.

BACKGROUND OF THE INVENTION

There has been used multi-camera or moving camera as input system toobtain information about a three-dimensional (3D) image.

If a large number of cameras are used, the 3D-image quality isdeteriorated due to vareations among the individual cameras andinstallation accuracy. Furthermore, where moving cameras are used,vareations among driving mechanisms present problems.

The following techniques have been proposed from the past.

A first prior-art technique consists of scanning to take only parallellight rays. It is composed of lens, aperture and imaging-devise, andaperture is disposed at the focal plane of lens to take only parallelray. (see, for example, JP-A-11-8863).

A second prior-art technique consists of scanning by the mirrors toobtain parallax images and making corrections to the magnification eachof the parallax images (see, for example, Japanese Patent No.3,537,218).

A third prior-art technique consists of obtaining integral photographyelemental image using micro lens arrays and relay lenses. A technique isalso disclosed increasing the viewing angle by scanning lenses (see, forexample, JP-A-2003-307800).

However, in the first prior-art technique, it is necessary to scanreadjusting the angle of light rays. Consequently, the scanning range isdifferent from the object range to take images. Furthermore, it isrequired complex processing for displayed to an auto-stereoscopicdisplay device using lenticular sheets or microlens arrays.Additionally, parallel light images cannot be taken in vicinities of theobject because there are not relay lenses. This poses the problem thatthe equipment is increased in size.

Furthermore, in the second prior-art technique, the magnificationvaries. This necessitates extra corrective processing. Another problemis that the camera angle needs to be varied to obtain information.

Additionally, in the third prior-art technique, it has three demerits.One, it is limited that a range of light rays gained in one operationbecause a lens-array is used. Tow, this leads to a deterioration of theresolution. Because the quantity of the individual lens takinglens-array image directly becomes the resolution of the gained 3D-image.Three, the equipment is increased in cost and size. Because thelens-array is necessary size covering the whole range of object.

Accordingly, the present invention provides an inexpensive,space-saving, three-dimensional light ray input apparatus.

BRIEF SUMMARY OF THE INVENTION

According to embodiments of the present invention, a three-dimensional(3D) light ray input apparatus inputs light from a three-dimensionalobject which is present on a plane consisting of the x-y axes in anorthogonal coordinate system and which has depth in the z-axisdirection. The light ray input apparatus has a first optical element, asecond optical element, a focusing element, an imaging element, and arecording portion. Each of the first and second optical elements has alength in the y-axis direction. The imaging element can image atwo-dimensional image. The first and second optical elements movetogether in the x-axis direction and scan light coming from the object.The first optical element distributes light rays from around the objectonto second optical element. (This distribution of light rays correspondindividual incident light-rays angle.) The light onto the second opticalelement is focused onto the imaging element by the focusing element. Theimaging element acts to image the focused light. (The second opticalelement relays distribution of light rays on second optical element planto imaging element.) The elemental image which is correspondingindividual incident light rays angle and has area onto x-y axes plan isimaged scanning to x-axis direction. The 3D image each position in thex-axis direction correspond each position scanning poison in the x-axisdirection. The recording portion records the elemental image taken bythe imaging element in the order of the scanning.

Another three-dimensional (3D) light ray input apparatus inputs lightfrom a three-dimensional object which is present on a plane consistingof the x-y axes in an orthogonal coordinate system and which has depthin the z-axis direction. The light ray input apparatus has a lightaperture control element, an optical element, a focusing element, animaging element, and a recording portion. Each of the light aperturecontrol element and the second optical element has a length in they-axis direction. The imaging element can image a two-dimensional image.The light aperture control element and the second optical element movetogether in the x-axis direction and scan light coming from the object.The light aperture control element distributes light rays from aroundthe object onto second optical element. (This distribution of light rayscorrespond individual incident light-rays angle.) The light onto theoptical element is focused onto the imaging element by the focusingelement. (The second optical element relays distribution of light rayson optical element plane to imaging element.) The elemental image whichis corresponding individual incident light rays angle and has area ontox-y axes plan is imaged scanning to x-axis direction. The imagingelement images the focused light. The 3D image each position in thex-axis direction correspond each position scanning poison in the x-axisdirection. The recording portion records the elemental image taken bythe imaging element in the order of the scanning.

A further three-dimensional (3D) light ray input inputs light from athree-dimensional object which is present on a plane consisting of thex-y axes in an orthogonal coordinate system and which has depth in thez-axis direction. The light ray input apparatus has an optical element,a light aperture control element, a focusing element, an imagingelement, and a recording portion. The optical element has a length inthe y-axis direction. The imaging element can image a two-dimensionalimage. The optical element moves in the x-axis direction and scans lightfrom the object. The light from the object is incident on the opticalelement. The light onto the optical element is focused onto the imagingelement by the focusing element through the light range control element.(The optical element relays distribution of light rays on opticalelement plan to imaging element.) The elemental image which iscorresponding individual incident light rays angle and has area onto x-yaxes plan is imaged scanning to x-axis direction. The imaging elementimages the focused light. The 3D image each position in the x-axisdirection correspond each position scanning poison in the x-axisdirection. The recording portion records the elemental image taken bythe imaging element in the order of the scanning.

According to the present invention, an inexpensive and space-savingthree-dimensional light ray input apparatus can be offered.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a plan view illustrating Embodiment 1 of the presentinvention.

FIG. 2 is a side elevation illustrating Embodiment 1.

FIG. 3 is a side elevation of the optical system of Embodiment 1 andlight rays, in which the light rays are not folded back by mirrors.

FIG. 4 is a plan view of the optical system of Embodiment 1 and lightrays, in which the light rays are not folded back by mirrors.

FIG. 5 is a side elevation of the optical system of Embodiment 2 andlight rays, in which the light rays are not folded back by mirrors.

FIG. 6 is a side elevation illustrating the manner in which a slit isinserted into a focal position on the side of an object.

FIG. 7 is a side elevation illustrating Embodiment 4.

FIG. 8 is a side elevation illustrating Embodiment 5.

FIG. 9 is a view illustrating the shape of a lens L1 for obtainingtwo-dimensional parallax.

FIG. 10 is a view illustrating the shape of a lens L2 for obtainingtwo-dimensional parallax.

FIG. 11 is a view illustrating vertical scanning for obtaining verticalparallax.

FIG. 12 is a view illustrating a directly placed display and a method ofgaining contents for the display.

FIG. 13 is a view illustrating a wide range of illumination using planarlight sources.

FIG. 14 is a view illustrating the manner in which a three-dimensionallight ray input apparatus 100 is made an enclosure.

FIG. 15 is a view illustrating the manner in which three-dimensionallight ray input apparatuses 100 are placed on a side surface and a topsurface, respectively.

FIG. 16 is a view illustrating the manner in which the wall surfaces ofthe enclosure of a object are made planar light sources.

FIG. 17 is a view illustrating the manner in which light ray informationis obtained with a 1-line sensor R.

FIG. 18 is a view illustrating the manner in which scanning is performedusing plural units.

FIG. 19 is a view illustrating light ray sampling.

FIG. 20 is a view illustrating the manner in which a start position istraced back.

FIG. 21 is a view illustrating the manner in which an image is distortedby a lens.

FIG. 22 is a view illustrating the manner in which a reference positionfor a display device that provides a display is varied.

FIG. 23 is a view illustrating the manner in which a light ray angle anda light ray position are taken as storage formats.

FIG. 24 is a view representing deviation of a lens.

FIG. 25 is a view illustrating the manner in which vertical stripes varywhen a rotation is made in the horizontal direction, i.e., on thexy-plane.

FIG. 26 is a view illustrating the manner in which vertical stripes varywhen a rotation is made in the depthwise direction, i.e., on theyz-plane.

FIG. 27 is a view illustrating the manner in which an image is distortedby a lens.

FIG. 28 is a view illustrating integral imaging.

FIG. 29 is a flowchart illustrating correction of image distortioncaused by a lens.

FIG. 30 is a flowchart illustrating conversion to an output format.

FIG. 31 is a view schematically illustrating the configuration of athree-dimensional image reconstruction apparatus.

FIG. 32 is a view taken from the above, illustrating the positionalrelationship between a three-dimensional image reconstruction apparatusand a three-dimensional image.

FIG. 33 is a view illustrating a case in which a slit array plate isdisposed.

FIG. 34 is a schematic view, taken from the front, of the slit arrayplate.

FIG. 35 is a view obtained by inverting FIG. 3 left and right.

FIG. 36 is a view obtained by rotating FIG. 32 by 90° in a clockwisedirection.

FIG. 37 is a view obtained by inverting FIG. 4 left and right.

FIG. 38 is a view illustrating discard of vertical parallax.

FIG. 39 is an explanatory view for the embodiment 14.

FIG. 40 is an explanatory view for the embodiment 17.

FIG. 41 is an explanatory view for the embodiment 18.

DETAILED DESCRIPTION OF THE INVENTION

A three-dimensional (3D) light ray input apparatus of one embodiment ofthe present invention is an apparatus which, when a three-dimensionalimage is reconstructed using a three-dimensional image reconstructionapparatus, records a three-dimensional image necessary for thereconstruction. Therefore, prior to describe the 3D light ray inputapparatus of the present embodiment, the 3D image reconstructionapparatus is described.

[A] Three-dimensional Image Reconstruction Apparatus

A 3D image reconstruction apparatus designed to display athree-dimensional image is first described by referring to FIGS. 31-34.

(1) Synopsis of Three-dimensional Image Reconstruction Apparatus

FIG. 31 is a view schematically showing the configuration of athree-dimensional image reconstruction apparatus.

A liquid crystal display 1501 has a color liquid crystal display screenon which subpixels of the three primary colors of R, G, and B areplanarly arranged in a matrix as described later. The liquid crystaldisplay 1501 is electrically driven by a driver device 1505 such thatparallax information is displayed in each column on the display screen.A backlight 1503 is disposed on the backside of the liquid crystaldisplay 1501. Light emitted from the backlight 1503 is shone on thedisplay screen of the liquid crystal display 1501.

A pinhole array plate 1502 is disposed on the opposite side of thebacklight 1503, i.e., located between the display screen of the liquidcrystal display 1501 and the observer. A three-dimensional real image1506 is reconstructed by light rays going out of pinholes 1509 in thepinhole array plate 1502. The image is recognized by the observer's eye1508.

A three-dimensional virtual image 1507 can also be reconstructed bytracing back the light rays from the pinhole array plate 1502 in thedirection going away from the real image 1506.

It is also possible to reconstruct a three-dimensional imagecontinuously across (i.e., both ahead of and behind) the pinhole arrayplate 1502.

Instead of the pinholes 1509, a well-known microlens array 1512 may beused.

(2) Configuration of Three-dimensional Image Reconstruction Apparatus

The 3D image reconstruction apparatus is configured as follows such thatit can reconstruct a natural, high-definition stereoscopic image thatdoes not suffer from color breakup when colors R, G, and B are mixed.

FIG. 32 is a view taken from above, illustrating the positionalrelationship between the 3D image reconstruction apparatus shown in FIG.31 and a 3D image.

The liquid crystal display 1501 which is seen by the observer 1508 to belocated behind the pinhole array plate 1502 provides a display ofparallax images that are viewed subtly differently according to angle,i.e., a set of multiaspect images. Light emitted from the set ofmultiaspect images passes through any one of the pinholes 1509 and formsa multiplicity of parallax image light rays. The light rays arecollected. As a result, a three-dimensional real image 1506(stereoscopic image) is reconstructed.

The minimum unit of excitation of the liquid crystal display 1501 thatdisplays a set of multiaspect images planarly is each of subpixels of R(red), G (green), and B (blue). Colors can be reproduced by threesubpixels of R, G, and B.

Each subpixel displays information about brightness and color at thepoint at which a straight line passing through the center of eachpinhole 1509 from each subpixel intersects a stereoscopic image on thedisplay space. Generally, there are plural points at which the straightline extending from the same subpixel and passing through the samepinhole 1509 “intersects the stereoscopic image”. However, only thepoint closest to the observer is taken as the displayed point. Forexample, in FIG. 32, a point P1 closer to the observer's eye 1508 thanP2 is taken as the displayed point.

(3) Other Configurations of Three-dimensional Image ReconstructionApparatus

FIG. 33 is a view showing the case where a slit array plate 1510 isdisposed instead of the pinhole array plate 1502 of FIG. 31.

FIG. 34 is a schematic view of the slit array plate 1510 as viewed fromthe front. Where the slit array plate 1510 is used, parallax in thevertical direction is intentionally discarded. The slit array plate 1510is easier to fabricate than the pinhole array plate 1502, and canreconstruct natural, high-definition stereoscopic images free from colorseparation in the same way as the pinhole array plate 1502.

A lenticular sheet 1513 may be used instead of the slit array plate1510.

[B] Theory of Three-dimensional Light-ray Input Apparatus

Three-dimensional light ray information is necessary to reconstruct athree-dimensional image. In the past, three-dimensional light rayinformation has been obtained from images of multi-camera. This methodof acquisition has the following two problems.

The first problem is extra processing for converting intothree-dimensional light ray information (elemental image array) frommulti-camera image.

The second problem is necessity of special multi-camera which hasviewing angle being varied between the horizontal and verticaldirections, in order to obtain efficiently correct three-dimensionallight ray information, when vertical parallax is discarded.

Accordingly, it is a purpose of the three-dimensional light ray inputapparatus of the present embodiment to gain three-dimensional light rayinformation that is made to correspond to the position of the 3D imagereconstruction apparatus as it is.

That is, the three-dimensional light ray input apparatus of the presentembodiment scans the optical system and an imaging element, the opticalsystem consisting of a plurality of optical elements to effectively gaina compact and exorbitant amount of three-dimensional light rayinformation. This apparatus has new feature to obtain correct andefficiency three-dimension light ray information for display whichvertical parallax is discarded. The information can display correctthree-dimension perspective image at standard viewing distance.

The 3D image reconstruction apparatus can reproduce 3D light rayinformation by arranging pixels pursuant to the 3D light ray informationbehind the pinholes 1502 as shown in FIG. 31. To provide such a display,it is necessary to obtain 3D light ray information pursuant to the 3Dimage reconstruction apparatus.

Accordingly, in the present embodiment, as shown in FIGS. 3 and 4, anoptical element L1 corresponds to a light ray control element of the 3Dimage reconstruction apparatus and converts the angle of light rays fromthe object into a position on an optical element L2. Where onlyinformation about light rays in a one-dimensional direction ispresented, it is necessary to gain a perspective image at a viewingdistance from the 3D image reconstruction apparatus in no parallaxdirections. Images coming from no parallax directions are focusedimaging element as perspective images by a focusing element L3. Thefocusing element L3 acts also to gain 3D light rays about parallaxdirections on the optical element L2.

It is also possible to replace the optical element L1 by a slit orpinhole array. Furthermore, where the optical element L1 and focusingelement L3 are made to have a conjugate relationship by the opticalelement L2; by putting slit or pinhole near on the focusing element L3,similar effect can be obtained without arranging the slit or pinholearray replacing the optical element L1. If a telecentric optical systemis adopted as the focusing element L3, similar effect can be produced byplacing a slit or a pinhole at the focal plane object-side of thefocusing element L3 and making conjugate the slit or a pinhole positionand the virtual position of the optical element L1 by the opticalelement L2.

“Light rays information” is a concept including various kinds of lightsuch as reflected light, transmitted light, and spontaneously emittedlight.

[C] Three-dimensional Light Ray Input Apparatus

Embodiments of the three-dimensional light ray input apparatus are nextdescribed by referring to drawings.

EMBODIMENT 1

The 3D light ray input apparatus 100 of Embodiment 1 is described byreferring to FIGS. 1-4.

(1) Configuration of 3D Light Ray Input Apparatus 100

FIG. 1 is a top view illustrating the present embodiment. FIG. 2 is itsside view.

The 3D light ray input apparatus 100 is composed of an optical system, adriving system for moving the optical system, and an imaging element forscanning image data whenever the optical system is driven and recordingportion for recording the image taken by the imaging element. Only theoptical system and imaging element within an enclosure 400 are shown.

As shown in FIGS. 1 and 2, a mirror M1 is installed integrally with acylindrical lens L1 and a cylindrical lens L2. M1 acts to bend anoptical axis passing across the lenses by about 90 degrees. Mirrors M2and M3 receive light from the mirror M1 and fold the light back to thefocusing lens L3. An array R(300) of photoelectric elements capable ofimaging a two-dimensional image sensor such as CCDs or CMOSes isdisposed behind the focusing lens L3.

(2) Definition of Orthogonal Coordinate System

As an orthogonal coordinate system representing light ray information,the horizontal direction (plane parallel to the paper of FIG. 2) of theplane view of FIG. 1 is referred to as the horizontal direction (planeconsisting of x- and y-axes), and the normal direction (directionperpendicular to the paper of FIG. 2) of the plan view is referred to asthe normal direction (z-axis direction).

According to the x, y, z coordinate system, lens L1, lens L2, and thearray R (300) of photoelectric elements capable of imaging atwo-dimensional image such as CCDs or CMOSes are elongated in the y-axisdirection. The scanning direction lies in the x-axis direction.

(3) Action of Three-dimensional Light Ray Input Apparatus 100

The lenses L1, L2 and M1 move integrally in the x-axis direction. Themirrors M2 and M3 are installed integrally, and move in the x-axisdirection at a velocity that is half of the moving speed of the lensesL1, L2 and mirror M1. this motion course not to vary the optical pathfrom the lens L1 if movement is induced by scanning. The area of themirrors M1, M2, and M3 correspond a light right image area. A necessaryarea of mirrors is installed pursuant to the area of light rays of anoptical system shown later.

(4) Principle of Input by Three-dimensional Light Ray Input Apparatus100

FIGS. 3 and 4 are views showing the light rays in an optical system,this illustrates are stretched straight and eliminated the mirrors ofthe present embodiment. FIG. 3 is a side view. FIG. 4 is a top view.(Actually these coordinate system, when clockwise turned by 90 degree,agrees with coordinate system of FIG. 1 or FIG. 2, for object, becausethis figure shows a state stretched straight.) The principle of input bythe three-dimensional light ray input apparatus 100 is described byreferring to FIGS. 3 and 4.

Let a be the distance between the cylindrical lenses L1 and L2.

Let b be the distance between the lenses L2 and L3. Let c be thedistance from the lens L3 to the array R of photoelectric area sensor.

The image side of each lens is indicated by a positive symbol (+). Theobject side is indicated by a negative symbol (−). The focal distance f1of the lens L1 is given by f1=a. The focal distance f2 of the lens L2 isgiven by −1/f2=1/a−1/b. With respect to the lens L3, the horizontalfocal distance f3h and the vertical focal distance f3v are different.The horizontal focal distance f3h is given by1/(a+b)−1/c=−1/f3hThe focal distance f3v in the vertical direction is given by1/b−1/c=−1/f3v

That is, the lens L1 collects parallel light from the object with thelens width in the horizontal direction. The light focused onto the lensL2 is focused onto the array R of the photoelectric area image sensorvia the lens L2 by the lens L3. In the vertical direction, the lens L3having long depth of focus directly focuses surface of the lens L1 ontothe array R of the photoelectric area image sensor. This is almost equalor tantamount to that the lens L3 focuses the object onto the array R ofthe photoelectric area image sensor.

The number of Parallax about the object as gained is as many as thenumber of horizontal direction pixels in the array R of photoelectricarea image sensor range of light, through the L1, L2 and L3. Using L2gives wide angle of the elemental image which is correspondingindividual incident light rays angle image, without need of use of awide area sensor. In the vertical direction, the image of the object canbe brought to a focus without parallax. The 3D image of the object inthe horizontal direction can be obtained by scanning. The image that isscanned by the array R of photoelectric area image sensor is stored inthe memory.

The inexpensive, space-saving, 3D light ray input apparatus 100 can beobtained by using the optical system which is area image sensor arrays Rof photoelectric elements or plural line image sensor arrays R ofphotoelectric elements and which folds back light rays by the mirrors asdescribed above. Furthermore, the optical efficiency is improved byusing the lenses.

The relation between vertical incidence and exit is shown in FIGS.35-38.

FIG. 35 is a side view of the optical system including the object. Backfolding at the mirror is omitted. The illuminate light is scattered onthe object to every direction. It is shown that real space is able to bereconstructed when information on light rays including light raydirection(s) is obtained as reconstructed. Light rays from variousdirections of the object are incident on the L1. In the figure, it isshowed that circled numerals 1 to 5 example of indicated light rays.Light rays of circled numerals 1 to 5 are collected at the position ofthe L1 and are distributed different positions on the L2. The light raysare focused onto the array R of photoelectric elements by the L2 andfocusing lens L3. At this time, the array of the circled numerals 1 to 5is inverted. An inversion occurs at the L1. Another inversion occurs atthe L3. Therefore, two inversions take place. These are scanned whilevarying the position of the optical elements and image sensor array. Asa result, it is obtained information from a large area.

When a 3D image is reconstructed on 3D display, elemental image which is3D light ray information is arranged on corresponding individualpositions. The elemental image is an image arranged with pixels incorrespondence with angle from image plane to light ray control elementssuch as lenses and slits. As a result, it is displayed 3D images varyingwith viewing point. This light ray control elements of 3D displaycorresponds the L1 of 3D light ray input apparatus. When pixels that isobtained from 3D light ray input apparatus are arranged as shown in FIG.36, light ray is outputted the light ray of object through the light raycontrol elements (such as lens array, pinhole array, lenticular sheet,or slit array). It can be seen that a three-dimensional object integralof light rays information entered at each position. For example, it isseen that the exactly the same 3D image is reconstructed by arrangingthe circled numerals 1 to 5 in the illustrated, the circled numeralsbeing gained in FIG. 35.

Where parallax in the vertical direction is discarded, the cylindricallens is used as a scanning lens as shown in the present embodiment. Thelenses L1 and L2 do not act in the vertical direction. In the verticaldirection, images is same normally images as shown in FIG. 37. When a 3Ddisplay is reconstructed, if a light ray control element (such aslenticular sheet or slit array) doesn't act to display parallax to thevertical direction as same as normal observation of images, as shown inFIG. 38. A perspective image from the shooting position can be observedin the vertical direction in the same way as in the case of normalimages. At this time, since a human has two eyes on the left and rightsides, he or she can obtain depth information from the only horizontalparallax between both eyes.

EMBODIMENT 2

A three-dimensional light ray input apparatus 100 of Embodiment 2 isnext described by referring to FIG. 5.

(1) Configuration of Three-dimensional Light Ray Input Apparatus 100

FIG. 5 is a side elevation showing an optical system and light rays. Inthe optical system, back folding using mirrors in the present embodimentis eliminated.

The plan view is substantially similar to FIG. 4. The differences withEmbodiment 1 are that (1) there is no lens L1, (2) the lens L3 has aslit (aperture) S, and (3) the focal distance of the lens L3 is the samedistance in the horizontal direction and in the vertical direction.

(2) Principle of Input by Three-dimensional Light Ray Input Apparatus100

The operation of the optical system is almost similar. It is scanning toobtain image data which is the horizontal parallax images and theno-parallax vertical images.

The difference of the optical system is the slit S used in the lens L3.Two effects are obtained by disposing the slit S at the surface of thelens L3 (in the vicinities of the position of the principal point), theslit S providing a contracting action only in the horizontal direction.The first effect is that the pupil of the lens L3 in the horizontaldirection decrease and the depth of field increases. Consequently, it isnot necessary to vary the focal distance of the lens L3 between thehorizontal and vertical directions. The second effect is that the slit Sacts as a virtual image and plays the role of the lens L1 of Embodiment1 (acting as a pinhole lens in the horizontal direction).

In consequence, parallax light rays can be obtained in the same way asin Embodiment 1. Since neither slit S nor the lens L2 acts in thevertical direction, it takes perspective images. Information in thehorizontal direction can be obtained by performing scanning.

In Embodiment 2, the focal distance of the lens L3 is same distance inthe horizontal and vertical directions and so the fabrication cost isreduced.

(3) Modified Embodiment 1

It is also conceivable to perform scanning via three mirrors in the sameway as in Embodiment 1. Lens L2 and mirror M1 are disposed integrally.Mirrors M2 and M3 are moved at a half velocity of scanning M1 to enterlight the focusing lens L3 such as same distance.

(4) Modified Embodiment 2

It is also conceivable to control the shape of the aperture S incidenton the L3 in the vertical direction and in the horizontal directionindependently. The size of the aperture in the vertical directioncorresponds to the image depth of field. The size of the aperture in thehorizontal direction corresponds to the obtained resolution (resolutionof the light rays) in the horizontal direction. If the aperture is madesmaller, obtainable is better resolution of the light rays. However, theaperture is corresponded the amount of light (exposure) in use, theaperture is adjusted vertically and horizontally according to thecircumstances.

EMBODIMENT 3

A three-dimensional light ray input apparatus 100 of Embodiment 3 isnext described by referring to FIG. 6.

In the present embodiment, a slit S is placed into the position of thefocal plane on the object side of the lens L3. Thus, the lens L3 selectsparallel light focusing image sensor. This also yields advantagessimilar to those of Embodiment 2. In this case, image sensor area ismore than wide lens L3 length in horizontal direction.

EMBODIMENT 4

A three-dimensional light ray input apparatus 100 of Embodiment 4 isnext described by referring to FIG. 7.

It is also conceivable to place the slit S in the lens L3 of the opticalsystem of Embodiment 1 like Embodiments 2 or 3. FIG. 7 is a sideelevation illustrating Embodiment 4.

As shown in FIG. 7, the slit S at the lens L3 corresponds to theeffective aperture in the lens L1. The effective aperture in the lens L1corresponds to the horizontal resolution. Because the effective aperturein the lens L1 is wide of light flux taking light ray images and wide oflight flux is the most effective scanning interval. It can be alsothought that the size of effective aperture is varied according to theresolution or amount of light (exposure) to be obtained. The resolutioncan be enhanced scanning more finely than the aperture pitch.

Furthermore, if the aperture of the lens L3 in the vertical directioncan be controlled independently, the depth of field in the verticaldirection can be varied. In other word, it is necessary to open apertureat “under exposure” since the S/N ratio decreases in dark scene; and itis better to close aperture at enough exposure and deep depth object. Inthe case of a scanning apparatus, fast exposure time is necessary forfast scan-speed. Conceivable is the design or construction whichincludes illuminator or lighting installation and has very smallaperture for achieving the deep depth of field.

EMBODIMENT 5

A three-dimensional light ray input apparatus 100 of Embodiment 5 isnext described by referring to FIG. 8.

If the aperture of the lens L1 is increased in order to enhance theoptical efficiency, the resolution at the gained position willdeteriorate. Accordingly, it is conceivable to gain light after focusingit instead of gaining only parallel light from the object.

FIG. 8 is a side elevation illustrating Embodiment 5.

As shown in FIG. 8, let e be the distance between the object and thelens L1. Let f1 be the focal distance of the lens L1. Under theseconditions, if there is a focusing relation given by1/e−1/a=1/f1then a satisfactory result occurs. In the lens L3, the focal distancediffers between the horizontal direction and the vertical direction.

In the horizontal direction, 1/(a+b+e)−1/ c=−1/f3h. In the verticaldirection, 1/b−1/c=−1/f3v.

Where the depth of field is small than the dept of the object, it isconceivable to make scans while varying the focal position plural times.In this way, the resolution can be increased while enhancing the opticalefficiency with a large lens size.

EMBODIMENT 6

A three-dimensional light ray input apparatus 100 of Embodiment 6 isnext described by referring to FIGS. 9 and 10.

It is also possible to obtain parallax in the vertical direction andparallax in the horizontal direction at the same time. FIG. 9 shows theshape of the lens L1 for gaining two-dimensional parallax. FIG. 10 showsthe shape of the lens L2 that is a two-dimensional optical element forgaining two-dimensional parallax.

Where a line of lenses like fly's eyes is adopted as shown in FIG. 9,parallax in the vertical direction can be obtained in the same way asthe methods of obtaining horizontal parallax already described inEmbodiments 1-5. At this time, the action of a normal lens is impartedto the lens L2 as shown in FIG. 10. To obtain two-dimensional parallax,the lens needs to relay two-dimensional power. Because of thisconfiguration, two-dimensional parallax can be obtained.

EMBODIMENT 7

A three-dimensional light ray input apparatus 100 of Embodiment 7 isnext described by referring to FIGS. 11 and 12.

It is also considered to make scans vertically to obtain verticalparallax. FIG. 11 illustrates scanning vertical parallax images to movein the vertical direction.

The vertical parallax images can be obtained by shifting the lens L3 tovertical direction together the array R of photoelectric elements. Theshift amount of the lens and the array R of photoelectric elements iscontrolled such that arranged as straight-lined are center of array R ofphotoelectric elements and the lens L3 and the object, in order to curbvariation or shift between the image center and the object center.Two-dimensional parallax can be obtained by making vertical scans inaddition to horizontal scans.

If the array R of photoelectric elements is sufficiently long, it is notnecessary to move the array R. An image center can be adjusted by amountof lens shift, even after imaging. Similarly, if lenses L1 and L2 havesufficiently long corresponding to parallax, it is not necessary to movethem.

Furthermore, as shown in the left-part figure of FIG. 13, it isconceivable to utilize a three-dimensional image display device suchthat the device looks down on the display surface placed flatbed. Ifcontents used at this time are imaged as shown in the right-part figureof FIG. 13, the same relation as the observing naked eye is achieved.Consequently, an image free of distortion can be obtained.

Additionally, vertical parallax can be scanned by newly installing aprism and scanning the angle of the prism. Vertical parallax can beobtained by varying the senses of three mirrors mounted therein to foldback the light. At this time, the array R of photoelectric elements canbe tilted in conformity with the mirrors.

EMBODIMENT 8

A three-dimensional light ray input apparatus 100 of Embodiment 8 isnext described by referring to FIGS. 13-16.

An example of illumination is illustratively shown in FIG. 13.

If the illuminated area is narrow, a reconstructing 3D image gives afeeling of oddness due to shade and anisotropy of the object. A lightguide plate used in the backlight of a liquid crystal display can alsobe employed. As shown in FIG. 13, “d” is supposed as a max depth oftaking 3D light ray image and θ is supposed as max angle of taking 3Dlight ray image. Width of light guide plate L is obtainable as L=2d tanθ. Because the object is illuminated flat brightness every angle.

If the taking image space is made an enclosure as shown in FIG. 14, thetaking image depth is determined by the height of the enclosure.

Furthermore, where the taking image space is made an enclosure as shownin FIG. 16, the wall surface of the enclosure can be illuminated as aplanar light source. Furthermore, if the side plate at the light guideplate directly enters the lens, the obtained data will be hindered.Therefore, the side plate can be separated from taking-image space andcan be machined with a mirror or the like.

It is also possible that plural direction illumination capable of beingcontrolled independently are installed and that plural images can betaken while varying the illumination. Images under various illuminationconditions can be synthesized by obtaining their images.

Making an enclosure is described. When an image is scanned over theobject, the system is composed of an enclosure accommodating the objectand a scanner gaining light ray information about the object. Thescanner can be opened and closed as an enclosure cover accommodating theobject. The scanner has a top portion made of glass to permit the userto check the composition while scanning the object.

As shown in FIG. 15, light ray information not only from the top butalso a side can be obtained at same time by installing scanners on theside and on the top, respectively.

EMBODIMENT 9

A three-dimensional light ray input apparatus 100 of Embodiment 9 isnext described by referring to FIG. 17.

FIG. 17 shows a configuration for obtaining parallax information with aline sensor R having only one rank array (in the case of color, threearrays of R, G, and B) of photoelectric elements.

The distance between lenses L1 and L2 is taken as the focal distance ofthe lens L2. And in this case, if it is also focal distance of the lensL1, scanning light ray is only parallel light ray. The scanning mirroris scanned while fixing the lenses L1 and L2. As such, parallaxinformation at that position can be scanned. After gaining the parallaxinformation at that position, the same procedure is repeated aftermoving next point the lenses L1 and L2. By adopting this procedure,parallax information and positional information can be scanned with onlyone line sensor R.

Similar effect can be obtained by making scanning while fixing L1, L2and scanning mirror (i.e., the relative positional relationship is keptconstant), shifting the positions of the scanning mirror relative to theL1 and L2, and making plural scans.

EMBODIMENT 10

A three-dimensional light ray input apparatus 100 of Embodiment 10 isnext described by referring to FIG. 18.

Scanning can also be performed using plural sensor arrays R and lensesat a time. FIG. 18 is a side elevation of an apparatus in which threeunits are combined.

As shown in FIG. 18, the scanning time is reduced to only one third bycombining units each having three lenses. Motion pictures can also begained if sensors and lenses are increased in number.

EMBODIMENT 11

A three-dimensional light ray input apparatus 100 of Embodiment 11 isnext described.

Color filters can be effectively used and parallax can be efficientlyobtained by installing lenses L1 and L2 at an angle on the x-y plane.

A method of enhancing the efficiency by obliquely disposing an opticalelement that splits light rays is known in display devices. Ifthree-dimensional light ray information is obtained using a lens tiltedat the same angle as an output display, the information can be outputtedto the display as it is.

EMBODIMENT 12

A three-dimensional light ray input apparatus 100 of Embodiment 12 isnext described by referring to FIGS. 24 to 28.

If the lens is tilted, accurate data cannot be obtained. Corrective datais obtained by inputting a test pattern. A correction can be made toachieve correct data. With respect to rotation of the lens, the amountof deviation can be obtained with a test pattern having verticalstripes.

Where a horizontal rotation is made (i.e., on the xy-plane) when thelens is tilted at an angle of φ in a coordinate system as shown in FIG.24, the stripes are seen to be tilted as shown in FIG. 25. Tilt in thedepthwise direction (rotation on the yz-plane) varies the thickness ofthe lines as shown in FIG. 26.

The way of correction is image processing how to change image fromcorrective data into ideal stripes as described above. Where thecorrection is too large, the arrangement of optical elements can bemodified, and a correction can be made by hardware.

As shown in FIGS. 21 and 27, a straight line that should be horizontalis distorted by a cylindrical lens. This is unavoidable because ofoptical characteristics. Therefore, the distortion data is gained. Acorrection can be made such that the line is change into an idealstraight line by image processing.

FIG. 29 shows one example of flowchart of acquisition of corrective dataabout finished products not yet shipped and a correction. The correctioncan be performed by this procedure.

That is, a vertical test pattern is obtained. Error data due to an arrayR of photoelectric elements and lenses L1, L2 is detected. If the erroris within a tolerable range, the error data is stored. If the error isoutside the range, the tilt of the lenses L1 and L2 is corrected. Then,a horizontal test pattern is obtained. Distortion data due to the lensesL1 and L2 is detected. The distortion data is stored.

EMBODIMENT 13

A three-dimensional light ray input apparatus 100 of Embodiment 13 isnext described by referring to FIGS. 29 and 30.

The obtained data is outputted redundantly in conformity with thecharacteristics of the display. Alternatively, a format of data withwhich any 3D image reconstruction apparatus can cope is considered.

The obtained data includes light ray information dependent on apositional function. If the data are held finely as they are, they canbe displayed as redundant data even on the designed 3D display(stereoscopic type, multi-view type, or integral imaging type). Integralimaging is a method of representing objects by; decomposing amultiplicity of light rays by lenses and slits (pinholes); andintegrating light rays as shown in FIG. 28 so that as same as suchdecomposing, a multiplicity of light rays reconstruct 3D image. Thearrangement of light rays may be traced back according to the number ofparallaxes in the three-dimensional image reconstruction apparatuses andobservation distance when to reconstruct the image even on the designed3D display.

For example, 4-view type pixel sampling when the angle of field of viewis θv is shown in FIG. 19. If there is a large amount of data available,any 3D image reconstruction apparatus can provide a display withoutdistortion. At this time, the format can be stored using x and y at theangle θ between the surface of the lens L2 and the surface of the lensL1 and at the coordinate position of the lens L1 as shown in FIG. 23because the angle of light rays is converted. As shown in FIG. 22, theposition of the 3D image reconstruction apparatus can be varied.

To match the multi-view type, the observation position is defined, thestarting point is defined, the display surface is defined and the pixelarrangement is determined by performing back tracing.

FIG. 30 illustrates one example of flowchart. By inputting data aboutthe output device, data can be outputted in the output format for thedevice.

The input data is corrected for distortion and stored as 3D light rayinformation. The display range and image size are converted using theoutputted information about the device. Information compressionindicating whether is done or not is entered. Compression is performed,and outputting is performed.

EMBODIMENT 14

In the hereto-mentioned embodiments, an image of whole of the scanningrange has to be captured when the light rays are not folded back bymirrors, because only the optical system or mechanism is moved. And, therange for capturing the light ray information, or an image obtained bywhole of the optical elements, corresponds to a part of an image-takingor imaging element. Utilization efficiency of the image-taking element Rfalls down because their positions vary depending on scanning positions.In view of this, it is aimed to provide a three-dimensional light-rayinput apparatus that eliminates a problem due to positional differencebetween the image-taking element R and the a range for obtaininglight-ray information, as to achieve efficient utilization of theimage-taking elements, and cost and space reduction.

FIG. 16 is a view for explaining construction of the Embodiment 14.Scanning-wise moving along the x-axis at same velocity in a manner as anintegral body is made in respect of the focusing element L3 and theimage-taking element R, or a planar array of the CCDs, as well as thelenses L1 and L2 that scan-wise move within a rectangular rangeindicated by a broken line in the FIG. 39. As a result of such en-blocmoving in a scanning manner, the light-ray information is obtainedsolely through respectively same parts of the image-taking element; andits efficient utilization is achieved.

EMBODIMENT 15

The lens L1 is replaced by the slit S, which is a light-ray controllingelement in a first category. The advantage or performance same as theembodiment 14 is achieved when the slit S and the lens L2 arescanning-wise moved at a same velocity with the focusing lens L3 and theimage-taking element R.

EMBODIMENT 16

The lens L1 is omitted in a manner as the embodiment 14; and an apertureor diaphragm is provided as a light-ray controlling element of secondcategory. The advantage or performance same as the embodiment 14 isachieved when the focusing lens L3 for image formation and the apertureelement as well as the image-taking element R are scanning-wise moved ata velocity same with that of the lens L2. When the light rays are foldedback by three pieces of the mirrors and their scanning-wise moving ismade, the advantage or performance same as the embodiments 14-16 isachieved.

EMBODIMENT 17

When an optical system including the three mirrors moves back and forth,or when whole of image-taking optical system is integrally driven to bescanning-wise moved, a range covered by the lens L2 is enough as a rangefor the image taking. In the hereto-mentioned embodiments, the aspectratio (or a ratio between length-wise dimension and width-wisedimension) of the image-taking element may differ from that of the lensL2 or a second optical element. In view of this, it is aimed to providea three-dimensional light-ray input apparatus that eliminates a problemdue to difference in the aspect ratio between the image-taking element Rand the second optical element, as to achieve efficient utilization ofthe image-taking element, and cost and space reduction. When ageneral-purpose area sensor is used for taking image, the difference inaspect ratio hampers the efficient utilization of “pixels” of theimage-taking element even if adjustment such as zooming is made.

In below, construction of embodiment 17 is described which is forcurbing problem due to the difference in aspect ratio between theimage-taking element R and the lens L2; by use of FIG. 40.

A telecentric optical system at image side is adopted only in horizontaldirection, in order to curb the problem due to the difference in aspectratio. Because scaling factor of the telecentric optical system isconstant, a lens L3 having a diameter larger than that of the lens L2 isrequired. A distance C2 between the focal point of the lens L3 and theimage-taking element R is adjusted in a manner to take an image from arange larger in diameter than the lens L″, so that the scaling factor ismodified or varied to achieve an image-taking range in conformity of theobject. Actually, focusing is made in vertical direction, and thus, thescaling factor is decided by focusing of the lens L3 for imageformation.

EMBODIMENT 18

Embodiment 18 is explained by use of FIG. 41. When diameter of the lensL2 is small, there is adopted a lens L4 that focus the light rays onlyor predominantly in a horizontal direction, or a cylindrical lens, as toachieve zooming only or predominantly in horizontal direction. In thisway, the difference in the aspect ratio is canceled.

1. A three-dimensional light ray input apparatus for inputting lightfrom a three-dimensional object which is present on a plane consistingof x-y axes in an orthogonal coordinate system and which has a depth ina z-axis direction, said apparatus comprising: a first optical element,a second optical element, a focusing element, an imaging element, and arecording portion, wherein each of said first and second opticalelements has a length in a y-axis direction, wherein said imagingelement is capable of imaging a two-dimensional image, wherein saidfirst and second optical elements move together in an x-axis directionand scan light from the object, wherein said first optical elementdistributes light rays from surroundings of the object onto said secondoptical element, wherein light focused on said second optical element isbrought to a focus on said imaging element by said focusing element,wherein said imaging element images (i) said light brought to a focus,(ii) light, which is present at each position in the x-axis direction onsaid second optical element is at a position on said imaging elementthat corresponds to each position in the x-axis direction, and (iii)light, which is present at each position on the second optical elementin the y-axis direction, at a position on the imaging element thatcorresponds to each position in the y-axis direction, and wherein saidrecording portion records images imaged by said imaging element in theorder of the scanning.
 2. A three-dimensional light ray input apparatusfor inputting light from a three-dimensional object which is present ona plane consisting of x-y axes in an orthogonal coordinate system andwhich has a depth in a z-axis direction, said apparatus comprising: afirst light aperture control element, a second optical element, afocusing element, an imaging element, and a recording portion, whereineach of said first light aperture control element and second opticalelement has a length in a y-axis direction, wherein said imaging elementis capable of imaging a two-dimensional image, wherein said first andsecond optical elements move together in an x-axis direction and scanlight from the object, wherein said first light aperture control elementdistributes light rays from surroundings of the object onto said secondoptical element, wherein light focused on said second optical element isbrought to a focus on said imaging element by said focusing element,wherein said imaging element images (i) said light brought to a focus,(ii) light, which is present at each position in the y-axis direction onsaid second optical element, at a position on said imaging element thatcorresponds to each position in the y-axis direction, and (iii) light,which is present at each position on the second optical element in thex-axis direction, at a position on the imaging element that correspondsto each position in the x-axis direction, and wherein said recordingportion records images imaged by said imaging element in the order ofthe scanning.
 3. A three-dimensional light ray input apparatus forinputting light from a three-dimensional object which is present on aplane consisting of x-y axes in an orthogonal coordinate system andwhich has a depth in a z-axis direction, said apparatus comprising: asecond optical element, a second light aperture control element, afocusing element, an imaging element, and a recording portion, whereinsaid second optical element has a length in a y-axis direction, whereinsaid imaging element is capable of imaging a two-dimensional image,wherein said second optical element moves in an x-axis direction andscans light from the object, wherein light from the object is incidenton said second optical element, wherein said light incident on thesecond optical element is brought to a focus on said imaging element viasaid second light aperture control element by said focusing element,wherein said imaging element images (i) said light brought to a focus,(ii) light, which is present at each position in the y-axis direction onsaid second optical element, at a position on said imaging element thatcorresponds to each position in the y-axis direction, and (iii) light,which is present at each position on the second optical element in thex-axis direction, at a position on the imaging element that correspondsto each position in the x-axis direction, and wherein said recordingportion records images imaged by said imaging element in the order ofthe scanning.
 4. A three-dimensional light ray input as set forth inclaim 1, wherein said first optical element is a single linear array ofoptical subelements.
 5. A three-dimensional light ray input apparatus asset forth in claim 1, wherein said second optical element is a singlelinear array of optical subelements.
 6. A three-dimensional light rayinput apparatus as set forth in claim 2, wherein said second opticalelement is a single linear array of optical subelements.
 7. Athree-dimensional light ray input apparatus as set forth in claim 3,wherein said second optical element is a single linear array of opticalsubelements.
 8. A three-dimensional light ray input apparatus as setforth in claim 1, wherein said focusing element performs scanning alongthe y-axis direction of said second optical element by means of a mirroror prism.
 9. A three-dimensional light ray input apparatus as set forthin claim 2, wherein said focusing element performs scanning along they-axis direction of said second optical element by means of a mirror orprism.
 10. A three-dimensional light ray input apparatus as set forth inclaim 3, wherein said focusing element performs scanning along they-axis direction of said second optical element by means of a mirror orprism.
 11. A three-dimensional light ray input apparatus as set forth inclaim 1, wherein said focusing element is a vareable focus.
 12. Athree-dimensional light ray input apparatus as set forth in claim 2,wherein said focusing element is a vareable focus.
 13. Athree-dimensional light ray input apparatus as set forth in claim 3,wherein said focusing element is a vareable focus.
 14. Athree-dimensional light ray input apparatus as set forth in claim 3,wherein said second light aperture control element is present near aprincipal point of said focusing element.
 15. A three-dimensional lightray input apparatus as set forth in claim 3, wherein said second lightaperture control element is present near a focal plane side of object.16. A three-dimensional light ray input apparatus as set forth in claim3, wherein said second light aperture control element is capable ofcontrolling an aperture width in the x-axis direction and an aperturewidth in the y-axis direction independently.
 17. A three-dimensionallight ray input apparatus as set forth in claim 1, wherein (A) there areprovided three reflective elements between said second optical elementand said focusing element, (B) said three reflective elements movetogether with said second optical element, (C) the reflective elementreflecting light from said second optical element moves at a speed twicea speed at which the other two reflective elements move, and (D) anoptical path length from said second optical element to said fixedfocusing element is constant.
 18. A three-dimensional light ray inputapparatus as set forth in claim 2, wherein (A) there are provided threereflective elements between said second optical element and saidfocusing element, (B) said three reflective elements move together withsaid second optical element, (C) the reflective element reflecting lightfrom said second optical element moves at a speed twice a speed at whichthe other two reflective elements move, and (D) an optical path lengthfrom said second optical element to said fixed focusing element isconstant.
 19. A three-dimensional light ray input apparatus as set forthin claim 3, wherein (A) there are provided three reflective elementsbetween said second optical element and said focusing element, (B) saidthree reflective elements move together with said second opticalelement, (C) the reflective element reflecting light from said secondoptical element moves at a speed twice a speed at which the other tworeflective elements move, and (D) an optical path length from saidsecond optical element to said fixed focusing element is constant.
 20. Athree-dimensional light ray input apparatus as set forth in claim 11,wherein a spacing between said first and second optical elements is setequal to the focal distance of said second optical element, and whereinsaid reflective elements are scanned while fixing said first and secondoptical elements.
 21. A three-dimensional light ray input apparatus asset forth in claim 18, wherein a spacing between said first and secondoptical elements is set equal to the focal distance of said secondoptical element, and wherein said reflective elements are scanned whilefixing said first and second optical elements.
 22. A three-dimensionallight ray input apparatus as set forth in claim 19, wherein a spacingbetween said first and second optical elements is set equal to the focaldistance of said second optical element, and wherein said reflectiveelements are scanned while fixing said first and second opticalelements.
 23. A three-dimensional light ray input apparatus as set forthin claim 1, wherein the focusing element and the imaging element movesin the x-axis direction integrally with the first and second opticalelements as to scanning-wise receiving light rays from thethree-dimensional object.
 24. A three-dimensional light ray inputapparatus as set forth in claim 2, wherein the focusing element and theimaging element moves in the x-axis direction integrally with the firstand second optical elements as to scanning-wise receive light rays fromthe three-dimensional object.
 25. A three-dimensional light ray inputapparatus as set forth in claim 3, wherein the second light aperturecontrol element as well as the focusing element and the imaging elementmoves in the x-axis direction integrally with the second optical elementas to scanning-wise receive light rays from the three-dimensionalobject.
 26. A three-dimensional light ray input apparatus as set forthin claim 3, wherein the focusing element and the imaging element movesin the x-axis direction integrally with the second optical element as toscanning-wise receive light rays from the three-dimensional object; andthe second light aperture control element is present near an object-sidefocal plane of the focusing element.
 27. A three-dimensional light rayinput apparatus as set forth in claim 23, futher comprising a thirdoptical element that achieves scaling of imaging in a maner that only arange capable to obtain light rays from the second optical element isfocused on a image-capturing area of the imaging element.
 28. Athree-dimensional light ray input apparatus as set forth in claim 24,futher comprising a third optical element that achieves scaling ofimaging in a maner that only a range capable to obtain light rays fromthe second optical element is focused on a image-capturing area of theimaging element.
 29. A three-dimensional light ray input apparatus asset forth in claim 25, futher comprising a third optical element thatachieves scaling of imaging in a maner that only a range capable toobtain light rays from the second optical element is focused on aimage-capturing area of the imaging element.
 30. A three-dimensionallight ray input apparatus as set forth in claim 26, futher comprising athird optical element that achieves scaling of imaging in a maner thatonly a range capable to obtain light rays from the second opticalelement is focused on a image-capturing area of the imaging element. 31.A three-dimensional light ray input apparatus as set forth in claim 23,wherein (A) there are provided three reflective elements between saidsecond optical element and said focusing element, (B) said threereflective elements move together with said second optical element, (C)the reflective element reflecting light from said second optical elementmoves at a speed twice a speed at which the other two reflectiveelements move, and (D) an optical path length from said second opticalelement to said fixed focusing element is constant.
 32. Athree-dimensional light ray input apparatus as set forth in claim 24,wherein (A) there are provided three reflective elements between saidsecond optical element and said focusing element, (B) said threereflective elements move together with said second optical element, (C)the reflective element reflecting light from said second optical elementmoves at a speed twice a speed at which the other two reflectiveelements move, and (D) an optical path length from said second opticalelement to said fixed focusing element is constant.
 33. Athree-dimensional light ray input apparatus as set forth in claim 24,wherein (A) there are provided three reflective elements between saidsecond optical element and said focusing element, (B) said threereflective elements move together with said second optical element, (C)the reflective element reflecting light from said second optical elementmoves at a speed twice a speed at which the other two reflectiveelements move, and (D) an optical path length from said second opticalelement to said fixed focusing element is constant.
 34. Athree-dimensional light ray input apparatus as set forth in claim 25,wherein (A) there are provided three reflective elements between saidsecond optical element and said focusing element, (B) said threereflective elements move together with said second optical element, (C)the reflective element reflecting light from said second optical elementmoves at a speed twice a speed at which the other two reflectiveelements move, and (D) an optical path length from said second opticalelement to said fixed focusing element is constant.